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© A sequence of image frames is compressed by 
dividing each frame into smaller blocks. Each block 
of all but the initial frame is compared with the 
corresponding block of the immediately previous 
frame, with only those blocks that are different being 
stored. A bit map 22 is used to store information 
about whether or not each block is different the 
corresponding block in the immediately preceding 
frame. To reconstruct a frame, this bit map is 
scanned for successive frames in reverse order, 
starting from the bits corresponding to the object 
frame to be reconstructed to determine in which 
frame each block last changed. The logical storage 
page of each block of the image data is then ob- 
tained by identifying the frame when that block last 
changed. Any frame can therefore be quickly re- 
constructed by accessing only those pages actually 
used to store block data of the frame to be re- 
constructed. 
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The present invention relates to a method of 
storing and compressing image data comprising a 
sequence of frames and of reconstructing a desired 
frame from the stored image data at high speed. 

In order to store a large volume of moving 
image data in a database, it is necessary to com- 
press the image data and thereby reduce the stor- 
age space that they occupy in a storage unit such 
as a disk. Besides intraframe compression of each 
frame (that is, each still image) in a moving image, 
it is possible to remove interframe redundancy by 
considering changes between frames in terms of 
time. An implementation of an interframe compres- 
sion method for dividing a frame into a plurality of 
blocks, for comparing each block with the cor- 
responding block in the immediately previous 
frame, and for storing each block in which a 
change exceeds a predetermined threshold level is 
disclosed by Hashihara in "Blocked Error Diffusion 
Method for Image Sequences," IBM TDB Vol. 33, 
No. 10A, pp. 94 - 95. March 1991. In this method, 
both the total number of blocks stored (in other 
words, the compression ratio) and the number of 
blocks being stored for each frame depend on the 
criteria for measuring changes. 

Fig. 1 shows how image data are stored when 
a moving image composed of a sequence of n 
frames fO, fi, ... , and fn-1 is compressed in accor- 
dance with an interframe method such as that 
described in the above-mentioned document Each 
frame is divided into D blocks, and block numbers 
from 0 to b are assigned from the upper left block 
to the lower right block (in the example, D = 16). 
The image data b (i, j) contained in block j of frame 
fi are compared with those contained in block j of 
the previous frame, ft-1. If the block has changed, 
the block number j is allocated to it as a tag. The 
image data contained in the block are stored in a 
logical page of the disk in ascending order of the 
frame number fi and the block number j. These 
operations are repeated for each frame and for 
each block. In the example shown in Fig. 1, the 
stored image data correspond to the block num- 
bers 0, 2, 5, 6, 1 1, and 15 of the blocks forming the 
frame fi. The image data stored in blocks may or 
may not be compressed within the blocks. 

If a sequence of frames of moving image data 
is interframe compressed and stored as shown in 
Fig. 1, the moving image can be played back by 
accessing the disk sequentially from the first logi- 
cal page. However, when a particular frame or a 
particular portion of moving image data is to be 
searched for at random, a sequential access opera- 
tion is also required, and as a result the search 
efficiency becomes low. In other words, extra 
pages that include image data of extra blocks not 
required for reconstructing the object frame have to 
be accessed before image data for an object frame 



(a frame to be reconstructed). In particular, the, 
search efficiency of the second naff of a sequence, 
of frames decreases markedly. When only in- 
traframe compression is performed, the efficiency. 

5 of the random access operation can be improved 
by creating an index for conversion from frame 
numbers to logical pages (for example, a B+ tree 
in which the first storage page for each frame is 
stored in a leaf node of the tree). However, when 

w interframe compression is also performed, a block i 
that is identicated with the corresponding block in . 
the immediately previous frame cannot be acces- 
sed by using the above-mentioned index scheme. 
Accordingly, the invention provides a method 

75 of compressing and storing image data comprising 
a sequence of frames, each frame consisting of a 
plurality of blocks, said method comprising the 
steps of: 

comparing each block in a current frame with 
20 the corresponding block from the immediately pre- 
ceding frame to determine whether the image data 
in the block has changed, and if so, storing the 
current image data from the block; 
and characterised by: 
25 storing in a table for each frame and block 
information indicating whether or not the image 
data in the block has changed from the corre- 
sponding block of the immediately preceding 
frame. 

30 This method allows any particular frame to be 
rapidly reconstructed. The number of logical pages " 
that are needed to be accessed to reconstruct the 
frame can be minimised (a logical page is a unit of 
the input and output operations of a storage unit). 

35 Thus in reconstructing a particular frame from mov- 
ing image data that are interframe compressed and 
stored, this approach speeds up operations for 
nonsequential access to frames. Any frame from 
the sequence of moving image frames with inter- 

40 frame compression can be reconstructed in a rela- 
tively short time, not significantly affected by the 
frame's location in the sequence of frames. This 
allows individual frames from moving image data to 
be flexibly retrieved at high speed. 

45 The number of blocks into which each frame is 
divided, the size thereof, the dividing method there- 
of, the contents of information stored as image data 
of blocks, and the criteria for determining changes 
in blocks are practically determined by the sped- 

so ftcations of the interframe compression, and are not 
directly relevant to the present invention. 

Preferably the information indicating whether or 
not image data in the block has changed is stored 
in the table as a bit map, each block of each frame 

55 being associated with a particular bit, and one 
predetermined bit value is stored in the table if is 
determined that the image data for that block and 
frame has changed from the corresponding block 
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of the immediately preceding frame, and the op- 
posite bit value if the image data has not changed. 
Other possible formats for the table include storing 
the information in the table as a set of numbers, 
each number being associated with a particular 
frame and block and identifying the frame when the 
image data in that particular block last changed. 

Thus image data formed from a sequence of 
frames can be compressed and the compressed 
image data stored in a storage unit. For each of the 
blocks contained in a given frame (other than the 
initial frame) it can be determined whether or not 
the block has changed since the immediately pre- 
vious frame, by comparing the block in the current 
frame with the corresponding block in the previous 
frame. If a change is found, image data from the 
block can be stored in a storage unit Appropriate 
information is also stored in a table to indicate that 
the block of the frame has changed or that it has 
not changed. 

The table can be a bit map storing a bit at a 
location determined both by a frame number de- 
fined to show the frame's position in the sequence 
of frames and by a block number defined to show 
the block's position in the frame. A change in a 
particular block of a particular frame is represented 
by storing one bit value at the corresponding loca- 
tion, and no change is represented by storing the 
opposite bit value at the corresponding location. In 
addition, a storage number representing the stor- 
age order of the image data in the storage unit can 
be assigned to every block that has changed. 

The invention also provides a system for com- 
pressing and storing image data comprising a se- 
quence of frames, each frame consisting of a plu- 
rality of blocks, said system comprising: 

means for comparing each block in a current 
frame with the corresponding block from the imme- 
diately preceding frame to determine whether the 
image data in the block has changed; 

means for storing the current image data from 
the block if it is determined that the image data in 
the block has changed from the corresponding 
block of the immediately preceding frame; 

and characterised by: 

means for storing in a table for each frame and 
block information indicating whether or not the im- 
age data in the block has changed from the cor- 
responding block of the immediately preceding 
frame. 

The invention further provides a method for 
reconstructing image data from stored, com- 
pressed image data, said image data comprising a 
sequence of frames, each frame consisting of a 
plurality of blocks, wherein the stored, compres- 
sesd image data consists only of those blocks of 
image data that differ from the image data in the 
corresponding block of the immediately preceding 



frame, an individual frame being reconstructed by: 
selecting blocks from the stored blocks of im- 
age data; 

assembling the selected blocks into the re- 

5 constructed image; 

the method being characterised in that associated 
with the stored, compressed image data is a table 
storing information for each block and frame in- 
dicating whether or not the image data in the block 

10 has changed from the corresponding block of the 
immediately preceding frame, and said step of 
selecting comprises: 

accessing the table in response to a request 
for a particular frame to be reconstructed; 

15 identifying from the table, for each block in the 
requested frame, the stored block containing the 
image data for that block; and 

accessing the identified stored blocks. 
Preferably the information is stored in the table 

20 as a bit map, each block of each frame being 
associated with a particular bit, with one predeter- 
mined bit value in the table indicating that the 
image data for that block and frame has changed 
from the corresponding block of the immediately 

25 preceding frame, and the opposite bit value indicat- 
ing that the image data has not changed, wherein 
said step of identifying comprises the step of: 

selecting frames in reverse order, starting with 
the requested frame; and 

30 scanning the bits for each selected frame to 
identify any stored blocks from the selected frame 
containing the same image data as the correspond- 
ing block for the requested frame, until a stored 
block has been identified for each block in the 

35 requested frame. 

It is also preferred that the stored blocks are 
arranged in pages in a storage unit, and said step 
of identifying further includes the step of determin- 
ing the page in which a stored block is located. 

40 Preferably the step of accessing the identifed 
stored blocks comprises the steps of. 

reading into a buffer a page which is deter- 
mined to contain at least one of said identified 
stored blocks; and 

45 determining which blocks in the page corre- 
spond to said at least one identified stored blocks. 

Thus the table can be accessed, in response to 
an inputted object frame number for reconstruction, 
to obtain for each block of the object frame the 

so number of the frame in the sequence up to and 
including the object frame in which the block last 
changed. The range of storage locations to be 
accessed is thereby determined according to the 
frame numbers obtained, and image data in the 

55 determined range obtained from the storage means 
to allow selection of the image data that constitute 
the object frame. 

The sequence of bits corresponding to succes- 
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sive frames in the bit map are scanned until an 
appropriate bit is found for every block, said scan 
starting from the sequence of bits corresponding to 
the object frame, and progressing through the 
frames in reverse order towards the sequence of 
bits corresponding to the initial frame. The storage 
number is calculated for each block that contains 
image data present in the object frame by using 
the block number and the obtained frame number, 
and the page of the storage means to be accessed 
is calculated from the storage number. The storage 
number of a block included in the page being 
accessed is then compared with the set of storage 
numbers containing blocks of image data from the 
object frame. 

The invention also provides apparatus for re- 
constructing image data from stored, compressed 
image data, said image data comprising a se- 
quence of frames, each frame consisting of a plu- 
rality of blocks, wherein the stored, compressesd 
image data consists only of those blocks of image 
data that differ from the image data in the cor- 
responding block of the immediately preceding 
frame, the apparatus comprising: 

means for selecting blocks from the stored 
blocks of image data; 

means for assembling the selected blocks into 
the reconstructed image; 

the apparatus being characterised in that the stor- 
age means further contains a table storing informa- 
tion for each block and frame indicating whether or 
not the image data in the block has changed from 
the corresponding block of the immediately pre- 
ceding frame, and said means for selecting com- 
prises: 

means for accessing the table in response to a 
request for a particular frame to be reconstructed; 

means for identifying from the table, for each 
block in the requested frame, the stored block 
containing the image data for that block; and 

means for accessing from the storage means 
the identified stored blocks. 

The reconstruction of frames is not limited to 
playing them back in order, but can also be used, 
for example, to extract statistics from the frames. 
Other possibilities are range reproduction: a frame 
sequence browsing operation for any range of 
frames, or frame movement a frame browsing op- 
eration for moving at random from one frame to 
another in both forward and backward directions. In 
the former case, the initial frame of the range is 
reconstructed, and thereafter, logical pages are se- 
quentially accessed, and images for blocks which 
are different from these in the immediately pre- 
vious frame are displayed. Thus, the frames after 
the initial frame can be sequentially reconstructed. 

An image data system can be constructed 
comprising: 



means for storing the image data from a se- 
quence of frames, each frame of which is com- 
posed of a plurality of blocks, a number defined in 
said sequence being assigned to each frame and a 

5 number also being assigned to each of said plural- 
ity of blocks, and for every frame other than the 
initial frame storing any block of image data that is 
different from the corresponding block of the im- 
mediately previous frame; 

io a table for finding the number of the frame in 
the sequence up to and including the current 
frame, in which said block last changed, for a given 
desired frame number and block number, 

means for accessing said table in response to 

75 an object frame number being inputted, and for 
obtaining the number of the frame, for each block 
of said object frame, in which said block last 
changed, in the sequence up to and including said 
object frame; 

20 means for determining the range to be acces- 
sed in said storage means according to the frame 
numbers obtained; and 

means for accessing said storage means in 
said determined range, obtaining image data, and 

25 selecting image data that constitute said object 
frame. 

An embodiment of the invention will now be 
described by way of example with reference to the 
following drawings: 
30 Fig. 1 is a schematic diagram showing the con- 
ventional format for storing block data 
Fig. 2 is a schematic diagram showing the struc- 
ture of a system in accordance with the present 
invention. 

35 Fig. 3 is a block diagram showing the compres- 
sion unit and the indexer of Figure 2. 
Fig. 4 is a schematic diagram showing a format 
of the frame sequence descriptor. 
Fig. 5 is a schematic diagram showing the for- 

40 mat for storing image data 

Fig. 6 is a flow chart showing the process of the 
access filter. 

Fig. 7 is a continuation of the flow chart of 
Figure 6 showing the process of the access 

45 filter. 

Fig. 8 is a schematic diagram showing the dis- 
play coordinates of a screen. 
Fig. 9 is a graph showing the results of an 
experimental investigation into frame reconstruc- 

50 tion using different methods. 

Fig. 10 is a schematic diagram showing an 
alternative format of the frame sequence de- 
scriptor. 

Fig. 1 1 is a flow chart showing the process of 
55 the access filter where the frame sequence de- 
scriptor shown in Fig. 10 is used. 
Fig. 2 is a system block diagram showing an 
indexer 12, an access filter 14, and a frame re- 
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production unit 16. The indexer 12 creates a frame 
sequence descriptor 22, which describes the result 
of comparing each block of each frame with the 
corresponding block of the immediately previous 
frame on the basis of the result of the interframe 
compression of a moving image by a comparator 
or compression unit 10. The indexer 12 stores the 
frame sequence descriptor 22 on a disk 20. The 
access fitter 14 reads the frame sequence descrip- 
tor 22 created by the indexer 12 from the disk 20 
to a memory. Thereafter, for the blocks required to 
reconstruct the object frame, the access filter 14 
creates a list of block storage numbers which in- 
dicate the storage order of the blocks in logical 
pages of the disk 20. The access filter 14 uses the 
list to calculate the logical pages of the disk 20 
which store the blocks. The frame reproduction unit 
16 reads logical pages calculated by the access 
filter 14 to the memory (not shown in the figure), 
one page at a time. Thereafter, the frame reproduc- 
tion unit 16 selects image data necessary for con- 
stituting the object frame from the pages and 
sends the resulting data to a display unit (not 
shown in the figure). A storage manager 18 con- 
verts logical pages into real physical addresses. 
Since the conversion into physical addresses can 
be performed by a known method, its description is 
omitted. The compression unit 10, the indexer 12, 
the format of the frame sequence descriptor 22 
created by the indexer 12, the storage format of 
image data, the process of the access filter 14, and 
the display process of the frame reproduction unit 
16 will now be described in detail. 

A) Compression unit and indexer 

Fig. 3 shows the compression unit 10 and the 
indexer 12 from in Fig. 2. The compression unit 10 
has the same structure as that used in the above- 
mentioned conventional method. An input image 
buffer 50 and a reference image buffer 52 store 
image data for each frame. The reference image 
buffer 52 stores image data of the frame imme- 
diately preceding the frame stored in the input 
image buffer 50. Image data with the same block 
number are read from the buffers 50 and 52. A 
differential calculator 54 calculates the difference 
between the two blocks of image data. The output 
of the differential calculator 54 is sent to a com- 
parator 54. The comparator 56 compares the out- 
put of the differential calculator 54 with a predeter- 
mined threshold value. The output of the compara- 
tor 56 is a binary, value determined by whether or 
not the difference exceeds the threshold value. If 
the difference exceeds the threshold value, a gate 
58 is opened and the image data of the input 
image buffer is sent to an output buffer 60. It is 
possible to place an intra-block compression unit 



between the gate 58 and the output buffer 60. After 
the contents of the buffers 50 and 52 have been 
compared for all the blocks, the content of one 
buffer 50 is copied to the other 52. Thereafter, 
5 image data of the next frame are stored in the first 
buffer 50. 

The indexer 12 is a unit for creating a bit map 
as shown in Fig. 4. The indexer 12 writes the 
output of the comparator 56 to a bit map in the 
ro buffer 62 whose bit location is determined both by 
the number of the frame stored in the buffer 50 and 
by the currently designated block number. Since 
bit map creation techniques are widely known, de- 
tails of the structure of the indexer 12 are omitted. 

B) Format of frame sequence descriptor 

The frame sequence descriptor created by the 
indexer 12 is a bit map in which one bit is assigned 

20 to each block included in the frame fi (where i is 
any non-negative integer less than n) in a se- 
quence of n frames fO, fi, fn-1. The bit map 
describes whether or not a particular block is dif- 
ferent from the corresponding block of the imme- 

25 diately previous frame fi-1. In this example, a 
change in a block is represented by "1 while no 
change in a block is represented by "0". In the 
frame sequence descriptor 22, a sequence of bits 
corresponding to one frame has a bit length equal 

30 to the number of all the blocks D included in one 
frame. This length is termed the length of the 
frame sequence descriptor. The size of the frame 
sequence descriptor is given by multiplying the 
length of the descriptor by the number of frames in 

35 a moving image to be compressed. Hereinafter, the 
bit in the frame sequence descriptor corresponding 
to block b of frame f is represented by FSD (f , b). 

C) Storage format of image data 

40 

As shown in Fig. 5, the image data of a block 
that has changed is stored on the disk starting from 
logical page 0. If the quantity of image data in one 
block is S bytes and the page size is P bytes, the 
45 maximum number of blocks N in one page can be 
expressed by the following equation: 

N = [P/S] (where [X] is the maximum integer that 
does not exceed x). 

50 

In this embodiment, a number that indicates a 
disk storage order is assigned to each block of 
image data stored on the disk. This number is 
termed a block storage number. If the total number 
55 of pages necessary for storing all changed blocks 
is q, the block storage number n satisfies the 
relation 1<=n<=N*q + N. Page p contains 
the stored image data of N blocks, which are 
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assigned the storage numbers N ' p + 1 to N * p 
+ N. 

D) Access fitter 

5 

The access filter receives the frame number of 
an object frame to be reconstructed. Next, as 
shown in Figs. 6 and 7, it obtains a block storage 
number n for the block b that constitutes an object 
frame (where b is a block number defined in one io 
frame as in the example of Fig. 1 , namely, 0 < = b 
< D), creating a list consisting of pairs <n, b> that is 
a combination of a block storage number n and a 
block number b, and calculates the logical page of 
the disk on which the image data of the above- is 
mentioned blocks are stored (2), in accordance 
with the following steps 1 to 7. 

(1) A frame number fi of an object frame to be 
reconstructed is inputted while the descriptor 22 

is read from the disk 20. At that time, for each 20 
frame fi (where 1 <= i < = n - 1), the sum c (fi) 
of bit values is calculated for the sequence of 
bits of the descriptor in the range from the initial 
frame to the frame immediately before the ob- 
ject frame. The sum c represents the total num- 2s 
ber of blocks stored on the disk 20 in the range 
from the initial frame fO to the frame fi-1 imme- 
diately before the object frame. In the example 
in Fig. 4, c (f2) is 24. Note that c (fO) is set to 0 
for the initial frame (fO). 30 

(2) A mask M with a bit length equal to the 
number of blocks D included in one frame is 
prepared in a memory. As initial values of the 
mask, all the bits are set to "1". As will be 
described later, whenever a logical storage page 35 
of image data of one block included in the 
object frame fi is calculated in the following 
process step, the corresponding bit location in 

the mask M is cleared to "0". 

In step 2, a set A of logical pages on the ao 
disk used for storing the image data of blocks 
constituting the object frame is initialized to an 
empty set. In addition, a list L of pairs <n, b> 
consisting of the block storage number n ob- 
tained for each block included in the object as 
frame and the block number b is initialized to an 
empty list. Finally, the current frame number f is 
initialized to fi. The number of blocks R for 
which the storage pages have not been found is 
initialized to the number of all blocks D. 50 

(3) When the number of blocks R for which the 
pages have not been found is "0", the process , 
is complete. Otherwise, for blocks in which the 
bit is "1", and for which accordingly the storage 
pages have not been found, changes in the 55 
current frame are searched for by using the 
sequence of bits of the descriptor corresponding 

to the current frame. For this purpose, as ex- 



pressed by the equation below, the current 
mask is ANDed bit by bit with the sequence of 
bits of the current frame for every block b 
(where 0 < = b < D). In other words, by using 
the b-th bit M (b) of the mask M and the bit FSD 
(f, b) of the descriptor corresponding to block b 
of the current frame f, the following calculation is 
performed: 

M (b) AND FSD (f, b) 



(4) When no block gives the calculation result 1, 
the current frame number is decremented by 1 
and the process returns to step 3. The block b 
that gives the calculation result 1 has a change 
in the current frame. With respect to block b, the 
storage order s (f, b) of the image data within 
the current frame is calculated by using the 
following equation: 

b 

s (f, b) = I FSD (f, k) 
k=0 

The value of c (f) obtained in step 1 in- 
dicates the total number of blocks stored on the 
disk in the range up to the frame immediately 
before the current frame f. Therefore, the block 
storage number n (f, b) of the block b can be 
expressed by the following equation: 

nff.b) = c(f) + s(f.b) 

A pair <n (f, b), b>, which is a combination of 
the block storage number n (f, b) and the block 
number b in the frame, is added to the list L 

(5) For a block b in which a change has been 
found in the current frame f in step 3, the page 
number p (f , b) on the disk where the block data 
are stored is calculated by using the following 
equation with the block storage number n (f, b), 
and the resulting page number p (f, b) is in- 
serted as an element of the logical page set A: 

p(f, b) = [n(f, b)/N], 

where duplicated page numbers are not repeat- 
edly inserted into set A. 

(6) The mask bit corresponding to the block of 
the current frame for which the storage page 
has been calculated is cleared to "0". In other 
words, the current mask bit M (b) and the one's 
complement of the descriptor bit FSD (f, b) are 
ANDed so as to obtain a new mask bit 
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M (b) = M (b) AND (NOT FSD (f, b)). 



(7) Following the above-mentioned steps for the 
current frame, the number of blocks in which the 
mask bit becomes "1" is subtracted from the 
variable R. The current frame number f is de- 
cremented by "1" and the process returns to 
step 3. 

When one frame has been reconstructed in 
such a sequential search of frames, another frame 
can be reconstructed without newly accessing 
blocks that have not been changed between these 
frames in order to obtain the image data contained 
in the object frame. Instead, only blocks whose 
descriptor bit is 1 for frames in the range between 
the frame ft that has been reconstructed and the 
object frame fj should be accessed. Thus, with a 
modified step 2 V of the above-mentioned step 2, 
the object frame can be reconstructed by acces- 
sing fewer pages on the basis of the frame that has 
been reconstructed. 

(2') First, the initial value of the current frame I 
is set to the object frame fj. If the object frame fj is 
followed by the frame fi that has been recon- 
structed (in other words, if fi > fj), the mask M is 
initialized by ORing the bit sequences of the de- 
scriptor in the range between the object frame fj 
and the current frame fi. In other words, the initial 
value for M(b) is given by the following equation: 

M (b) = FSD (fj, b) OR 

FSD (fj+1, b) OR 

OR 

FSD (fi, b) 

In contrast if the object frame fj is preceded 
by the frame fi that has been reconstructed (in 
other words, if fi < fj), the mask M is initialized by 
ORing the bit sequences of the descriptor in the 
range between the frame immediately following the 
current frame fi and the object frame fj. In other 
words, the initial value for M(b) is given by the 
following equation: 

M (b) = FSD (Fi+1, b) OR 

OR 

FSD (fj, b) 

In any case, variable R, the number of blocks 
for which the storage pages have not been found, 
is set to the number of bit counts included in the 



mask M where bit = 1. 

E) Display process of the frame reproduction unit 

5 The logical pages in the set A calculated by 

the access filter are sorted in ascending order of 
their page numbers. Thereafter, each page p is 
processed in the following manner 

(11) The data in logical page p are read into a 
10 buffer in the memory. 

(12) The image data that are read into the buffer 
consist of N blocks, whose storage numbers are 
in the range N • p + 1 to N * p + N. Tne 
storage numbers of the blocks that contain im- 

is age data necessary to reconstruct a frame are 
included in the list L along with the block num- 
bers. Thus, when an i-th block (1 < = i < = N) in 
the buffer and a pair <j, b) in the list L satisfies 
the equation N * p + i = j, the data in the buffer 

20 corresponding to the storage number N * p + i 
are shown on the display unit. At that time, the 
screen coordinates (x, y), which are the starting 
point from which the image data of the block i 
are displayed, are calculated by using the foh 

25 lowing equations with the conditions that the 
initial coordinates of the whole frame are (xO, 
yO), the numbers of blocks in the x and y 
directions are Dx and Dy (Dx " Dy = D), respec- 
tively, the numbers of pixels in the x and y 

30 directions for one block are Kx and Ky, respec- 
tively, and the block number is b. 

x = xO + (b%Dx)*Kx 
y = yO + (b/DyrKy 

35 

(where % denotes an operator for obtaining a 
remainder). 

In the example shown in Ftg. 8, the initial 
coordinates (x6, y6) for the block 6 are obtained by 
40 the following equations: 

x6 = xO + 100 
y6 = yO + 50 

45 An experiment was performed to investigate 
the performance of different frame 
storage/reconstruction methods. Fig. 9 shows the 
relation found between the frame number and the 
number of logical pages that are accessed so as to 

50 reconstruct the frames for a sample moving image. 
The sample moving image consists of 80 frames, 
and the frame size is 48 kB (256 x 192 pixels). The 
logical page size is 4 kB and the block size is 64 
Bytes (8x8 pixels). In this case, the compression 

55 rate is 35.8%. Although the frame sequence de- 
scriptor is stored in a disk space, this space is 
much smaller than that required for image data. In 
the case of the above-mentioned sample image, 
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the size of the descriptor in relation to that of the 
compressed image data is approximately 0.5%. 

In reconstruction method 1 , frames are sequen- 
tially accessed from the initial frame to the object 
frame. In method 2, frames are accessed from a 
middle frame to an object frame, the middle frame 
being followed by the object frame, and all blocks 
of the middle frame are different from those of the 
object frame. Method 3 corresponds to that of the 
present invention. When method 3 is compared 
with the method 1 and method 2 in terms of the 
increase in the number of pages to be accessed as 
the frame number increases, it is found that the 
rate of increase in method 3 is lower than in 
methods 1 and 2. In particular, because of the 
scene change at the 38-th frame of the sample 
moving image, it is clear that, in method 3, the 
effect of the access filter is significant in the sec- 
ond half of the sequence of frames, and that in the 
frames that follow the scene change, the number of 
pages accessed for the reconstruction decreases 
markedly. In other words, method 3 makes it possi- 
ble to reconstruct the frames following the frame 
with the scene change at a high speed by using 
the scene change frame and images of blocks 
changed after the scene change. 

The purpose of the FSD table is to give the 
frame number of the block last changed, in a 
sequence up to and including the current frame, for 
any block of any frame. However, the form of the 
table is not limited to the bit map shown in Fig. 4. 
For example, it is possible instead to use the 
format shown in Fig. 10 for the frame sequence 
descriptor. In the format shown in Fig. 10, in the 
number sequence corresponding to each frame 
number, a frame number is given for each block in 
the frame to show where that block last changed in 
the sequence of frames from the initial frame up to 
and including the current frame. One frame number 
is described by a binary code with a plurality of 
bits. To create the frame sequence descriptor 
shown in Fig. 10, the indexer 12 shown in Fig. 3 
should operate as follows: 

(21) A number 0 is written to the output buffer 
62 at each location corresponding to each block 
of frame 0. In addition, the content of the frame 
sequence descriptor for frame 0 is temporarily 
stored in a buffer (termed a previous frame 
buffer) other than the output buffer 62. 

(22) Trie following operation is performed for 
block b (0 < = b < D) of frame fi (1 <= fi). 

When the output of the comparator 56 indi- 
cates that block b of frame fi is different from block 
b of frame fi-1, the number fi is written to the 
output buffer at a location determined by the num- 
bers fi and b. In contrast, when the output of the 
comparator 56 indicates that a change has not 
occurred, the content of the location corresponding 



to block b of the previous frame buffer is written to 
the output buffer at a location determined by the 
numbers fi and b. 

Using the descriptor shown in Fig. 10, the 
5 access filter calculates the logical page to be ac- 
cessed in accordance with the steps shown in Fig. 
11. Unlike in the steps shown in Figs. 6 and 7, the 
mask M and the variable R are not used. 

(31) The same process as in step 1 is per- 
10 formed. However, the descriptor shown in Fig. 

10 does not describe whether or not each block 
is changed. Thus, two number sequences cor- 
responding to two successive frames are stored 
in different buffers. The contents of the two 
75 buffers are compared and information equivalent 
to bit 1 in Fig. 4 is then obtained, c (fi) is then 
calculated in accordance with the resultant in- 
formation. 

(32) This step is the same as step 2 except that 
20 only the set A and the list L are initialized. 

(33) A sequence of numbers corresponding to 
the object frame number fi is accessed. Thus, 
for each block h, the frame number f is obtained 
for the frame in which the block last changed, 

25 including frame fi. 

(34) Two sequences of numbers corresponding 
to frame f and the immediately previous frame 
are stored in different buffers. The number of 
blocks that differ in the two buffers is counted in 

30 the range up to and including block b. In this 
way, the storage order s (f, b) of block b of 
frame f is calculated. The calculation of n (f, b) 
and addition of the pair <n (f, b), b> to the list L 
are as in step 4. 
35 (35) This step is the same as step 5. 

So far, it has been assumed that the number of 
blocks stored in one logical page is constant How- 
ever, when the compression unit 10 performs intra- 
block compression, the quantity of image data per 
40 block is not constant. Thus, the number of blocks 
per logical page may vary. Consequently, a page 
number cannot be obtained in accordance with the 
equation described in step 5. In this case, it is 
necessary to create a table describing a block 
45 storage number for the first block in each logical 
page when the compression unit 10 compresses 
image data. With such a table, a page number to 
be accessed can be obtained by comparing n (f, b) 
with the block storage number for the first block in 
so each page in step 5. 

Claims 

1. A method of compressing and storing image 
55 data comprising a sequence of frames, each 

frame consisting of a plurality of blocks, said 
method comprising the steps of: 

comparing each block in a current frame 
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with the corresponding block from the imme- 
diately preceding frame to determine whether 
the image data in the block has changed, and 
if so, storing the current image data from the 
block; 5 

and characterised by: 

storing in a table (22) for each frame and 
block information indicating whether or not the w 
image data in the block has changed from the 
corresponding block of the immediately pre- 
ceding frame. 

2. A method as claimed in claim 1, wherein the is 
information is stored in the table as a bit map, 
each block of each frame being associated 

with a particular bit, and storing one predeter- 
mined bit value in the table if is determined 
that the image data for that block and frame 20 
has changed from the corresponding block of 
the immediately preceding frame, and the op- 
posite bit value if the image data has not 
changed. 

25 

3. A method as claimed in claim 1, wherein the 
information is stored in the table as a set of 
numbers, each number being associated with a 
particular frame and block and identifying the 
frame when the image data in that particular 30 
block last changed. 



stored, compressed image data, said image 
data comprising a sequence of frames, each 
frame consisting of a plurality of blocks, 
wherein the stored, compressesd image data 
consists only of those blocks of image data 
that differ from the image data in the cor- 
responding block of the immediately preceding 
frame, an individual frame being reconstructed 
by: 

selecting blocks from the stored blocks of 
image data; 

assembling the selected blocks into the 
reconstructed image; 

the method being characterised in that asso- 
ciated with the stored, compressed image data 
is a table (22) storing information for each 
block and frame indicating whether or not the 
image data in the block has changed from the 
corresponding block of the immediately pre- 
ceding frame, and said step of selecting com- 
prises: 

accessing the table in response to a re- 
quest for a particular frame to be reconstruct- 
ed; 

identifying from the table, for each block in 
the requested frame, the stored block contain- 
ing the image data for that block; and 

accessing the identified stored blocks. 



4. A system for compressing and storing image 
data comprising a sequence of frames, each 
frame consisting of a plurality of blocks, said 35 
system comprising: 

means (10) for comparing each block in a 
current frame with the corresponding block 
from the immediately preceding frame to de- 40 
termine whether the image data in the block 
has changed; 

means (18) for storing the current image 
data from the block rf it is determined that the 45 
image data in the block has changed from the 
corresponding block of the immediately pre- 
ceding frame; 

and characterised by: 50 

means (12) for storing in a table (22) for 
each frame and block information indicating 
whether or not the image data in the block has 
changed from the corresponding block of the 55 
immediately preceding frame. 

5. A method for reconstructing image data from 



6. A method as claimed in claim 5, wherein the 
information is stored in the table as a bit map, 
each block of each frame being associated 
with a particular bit. with one predetermined bit 
value in the table indicating that the image 
data for that block and frame has changed 
from the corresponding block of the imme- 
diately preceding frame, and the opposite bit 
value indicating that the image data has not 
changed, wherein said step of identifying com- 
prises the step of: 

selecting frames in reverse order, starting 
with the requested frame; and 

scanning the bits for each selected frame 
to identify any stored blocks from the selected 
frame containing the same image data as the 
corresponding block for the requested frame, 
until a stored block has been identified for 
each block in the requested frame. 

7. A method as claimed in claim 5 or 6, wherein 
the stored blocks are arranged in pages in a 
storage unit (20), and said step of identifying 
further includes the step of determining the 
page in which a stored block is located. 
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& A method as claimed in claim 7, wherein the 
step of accessing the identrfed stored blocks 
comprises the steps of: 

reading into a buffer a page which is de- 
termined to contain at least one of said iden- 5 
tified stored blocks; and 

determining which blocks in the page cor- 
respond to said at least one identified stored 
blocks. 

10 

9. Apparatus for reconstructing image data from 
stored, compressed image data, said image 
data comprising a sequence of frames, each 
frame consisting of a plurality of blocks, 
wherein the stored, compressesd image data 15 
consists only of those blocks of image data 
that differ from the image data in the cor- 
responding block of the immediately preceding 
frame, the apparatus comprising: 

20 

means (14) for selecting blocks from the 
stored blocks of image data; 

means (16) for assembling the selected 
blocks into the reconstructed image; 
the apparatus being characterised in that the 25 
storage means further contains a table (20) 
storing information for each block and frame 
indicating whether or not the image data in the 
block has changed from the corresponding 
block of the immediately preceding frame, and 30 
said means for selecting comprises: 

means for accessing the table in response 
to a request for a particular frame to be re- 
constructed; 35 

means for identifying from the table, for 
each block in the requested frame, the stored 
block containing the image data for that block; 
and 

means for accessing from the storage 40 
means the identified stored blocks. 
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FIG. 11 
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